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HERE has been increasing emphasis 
Tae the literature to the effect that the 
contradictory results encountered in vali- 
dation studies of projective techniques 
may be due partly to the possibility that 
some of the underlying assumptions are 
sound but others faulty. For this reason 
it has been urged that closer scrutiny of 


‘This monograph is based on a doctoral dis- 
sertation at Columbia University. 
Shaffer, Chairman of the Doctoral Committee, 
and Edward V. Shoben, Jr. and Robert L. 
Thorndike, members of the committee, guided 
the development of the study as a whole. Helen 
M. Walker, Gordon F. Derner, and Herbert J. 
Zucker also contributed to the development of 
the study. Philip Brandis, Helen A. Diers, Joan 
Fox, Isidore Helfand, Shabse H. Kurland, Mon 
roe L. Levin, Eugene Levitt, Reuben M. Mar 
golis, Martha Hessel Page, Alfred Rubinstein, 
and Loron M. Simon helped in judging certain 
of the materials. 

Special credit is due the United States Air 
Force which granted laboratory facilities and the 
cooperation of its staff under the Personnel Re 
search Field Section Human Resources Research 
Center, Sampson Air Force Base, Geneva, New 
York, and which provided subjects for the ex 
periment. Donald B. DuBois served as consul- 
tant on the scene. 


Laurence F. 


The study is also indebted to the following 
Weston A. Bousfield, who gave access to research 
facilities in the Department of Psychology at 
the University of Connecticut for important pre- 
liminary aspects of the study; The Psychologi- 
cal Corporation, which supplied the Levy Move 
ment Cards; the late Oliver D. Havard, of Al- 
lentown, Pennsylvania, who gave financial sup- 


port to certain phases of the study; and, finally, 


my wite, Ruth, who assumed many of the un- 
enviable routine tasks and other burdens in- 
volved. 


I am deeply grateful to all. 
? Now at the Rochester Guidance Center, New 
York. 


Consistency of Projective Movement Responses’ 


specific practices and their theoretical 
bases is needed to screen those which may 
be retained from those which should be 
modified or discarded, 

Among the practices which often have 
been challenged has been the observation 
and diagnostic interpretation of move- 
ment, as conceptualized in various sym- 
bolic or representational terms furnished 
by language, art, and other expressive 
media, and converted into psychological 
test procedures. The Rorschach “move- 
ment response,” comprising those “con- 
projected some kind of 
action or life into ink blots” (13, p. 109), 
represents perhaps the best known appli- 
cation of the principle. 


cepts which 


Fundamental to the observation and 
interpretation of conceptualized move- 
ment in the projective techniques has 
been the explicit or implicit assumption 
that the movement response occurs as a 
function of something deep rooted and 
stable in the individual. Observed as a 
test response, it has thus been presumed 
to yield revealing and dependable clues 
to personality and behavior. While some 
evidence directly or indirectly relevant to 
this proposition is to be found in the 
experimental literature, research to date 
has not been conclusive. The present 
study, therefore, has sought to add some 
clarification. 


Methodological Approaches 


Previous approaches to the problem 
have usually taken one of two directions: 


' : 


(a) attempting to establish a direct rela- 
tionship between movement responses 
and personal attributes thought to have 
important and durable 
significance and (b) examining the con- 
sistency or inconsistency of movement 


psychological 


scores and derived indices. The search 
for correlates has been inconclusive partly 
because validity of the criteria used to 
define correlative variables has not al- 
ways been demonstrated. More basically, 
however, these studies have been weak 
because they have uncritically assumed 
the movement indices provided person- 
ally relevant behavioral data largely in- 
susceptible to chance distortion or to sys- 
tematic error. Since both experimental 
successes and failures might conceivably 
be accounted for in either of these terms, 
it has been difficult to determine in spe- 
cific instances what interpretation might 
be put on observed results. 

Studies following the second approach 
have in turn been indecisive because es- 
sential standards for testing clinical hy- 
potheses concerning stability and varia- 
tion in behavior have not been met. The 
shortcoming becomes evident when re- 
searches are weighed against basic re- 
quirements for examining the individu- 
al’s variability in relation to pre- 
sumed “true” score or typical perfor- 
mance. 

Zubin (29) has discussed these requi- 
sites at length. Key points may be ap- 
plied to the present problem as follows: 
(a) the individual must be regarded as 
an independent universe of behavior; 
(b) each observation (in this case, the 
movement score) must be treated as a 
random sample from this universe; (c) 
sampling must be sufficiently extensive 
to provide a definitive estimate of the 
individual's range of variability within 
his universe; (d) observations must be 
based on a mathematical model (e.g., ex- 
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pansion of the binomial) which permits 
any observed range of variability to be 
tested rigorously for its significance; (e) 
the performance of the individual must 
be treated integratively as well as differ- 
entially in relation to that of others. 


Studies of Consistency in the Movement 
Response 


Researches pertaining intra-indi- 
vidual variability in the movement re- 
been Rorschach 


studies. Most of them have been investi- 


sponse have usually 
gations of reliability using split-half, or 
single-repetition test-retest designs. In 
some cases special operations have been 
introduced to test the stability of the 
subject's scores under varied sets, sug- 
gestions, stresses, drugs, and other experi- 
mental conditions relating either to the 
subject, to the examiner, or to the test 
situation as a whole. Miller (17) has re- 
viewed the work in this area and has out- 
lined various possible sources of varia- 
tion in the subject's scores. 

Other considerations aside: the studies 
of reliability have generally provided no 
more than two estimates or tests of the 
subject’s performance level. Assuming 
that the two estimates are independent 
and that there is equal probability for 
any two alternative performance levels 
(e.g., high or low) in either test, then the 
statistical significance of complete agree- 
ment, or of complete disagreement, be- 


tween the two estimates is + or 
only .5—exactly what is expected by 
chance. Under these conditions it can- 


not be determined whether any subject 
has been significantly consistent or sig- 
nificantly inconsistent in his perfor- 
mance level. 

Exceptions to this criticism have been 
longitudinal Rorschach studies like that 
done by Ives, Grant, and Ranzoni (11) 


and the study of internal consistency in 


the Rorschach categories done by Wit- 
tenborn (28). Other considerations, how- 
ever, have limited the implications of 
these studies for the present problem. 

A number of researchers, for example, 
have suggested that, if the movement re- 
sponse truly involves significant personal 
attributes, it should reveal a_ broadly 
general character not confined to the 
Rorschach situation. Wittenborn (28) in- 
terpreted this hypothesis as consonant 
with underlying Rorschach assumptions. 
He suggested that, if the assumptions 
held, subjects might be expected to con- 
ceptualize movement with consistent fre- 
quency on a variety of tests which of- 
fered perceptual alternatives. Sanford 
(22) suggested that subjects who pro- 
jected action into inkblots might be ex- 
pected to inject action into scenes and 
situations which they depicted verbally. 
Others have likened the verb-adjective 
quotient used in analyzing verbal ma- 
terials to the Rorschach movement-color 
ratio. 

Going beyond the point of specula- 
tion, several investigators have offered 
presumably alternative or supplemen- 
tary inkblot test forms, e.g., the Behn 
(31) and Harrower (8) series, claimed to 
vield results consistent with those of the 
Rorschach. Others have adopted or mod- 
ified the Rorschach for the ex- 
perimental and diagnostic observation 


model 


of movement in other types of tests in- 
volving interpretation or production of 
drawings, paintings, mosaic designs, toy 
arrangements, etc. The hypothesis of in- 
tra-individual consistency in conceptual. 
izing movement might be extended to 
these techniques as well. 

Several studies have offered direct evi- 
dence bearing on the consistency of the 
subject in movement production as ob- 
served in comparisons between different 


tests—the Rorschach 


the 


has served as 
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denominator in 


common these re- 
searches. The broadest was that of May- 
man (15) who made comparisons be- 
the Rorschach inkblots, on the 
one hand, and the Behn (31) and Har- 
rower (8) series on the other. Extending 
beyond the inkblot frame of reference, 
King (12), and Allen, Ray, and Poole (1) 
compared Levy Movement perfor- 
mance with that on the Rorschach. Hays, 
Gellerman, and Sloan (9) compared 
movement indices on the Rorschach with 
verb-adjective quotients in TAT proto- 
cols. 


tween 


Since completion of the present study, 
Epstein, Nelson, and Tanofsky (7) have 
reported an exceptional investigation us- 
ing ten sets of newly devised inkblots 
totaling all; apart from this, 
studies have been subject to the same 


100 «in 


weakness stressed in connection with the 
Rorschach studies described earlier: in- 
adequate samplings of the individual's 
universe of test performance. Their re- 
sults, therefore, have been equally inde- 
cisive. The question substantially 
mains: Does the movement response oc- 
cur with such intra-individual consis- 
tency as to warrant the assumption that 
it represents some intrinsic, stable, per- 
sonal variable? Resolution of the ques- 
tion would not only help to clarify the 


status of the 


with 
respect to its basic assumptions in the 


movement response 
Rorschach and similar tests, but might 
also contribute to the development of 
sound theory and practice in the projec- 
tive techniques generally. The present 
study, therefore, has undertaken to ex 
plore the question according to some of 
the principles outlined by Zubin (29) 
and described earlier. 


Hypothesis of the Present Experiment 


It is hypothesized that, if the move- 
ment response, broadly defined, is a func- 
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tion of something deep rooted and stable 
in the individual, then his level of move- 
ment production as compared to that of 
other individuals is consistent over a 
range of different test situations. 


PROCEDURES 


As a general frame of reterence, a 
movement response was defined as the 
verbal stipulation of some action. Sub- 
ject to this limitation and to the modi- 
fications described below, conceptualized 
movement was observed in six different 
tests, all administered and scored by the 
experimenter. The tests were of two types 
conveniently designated as Perceptual 
and Verbal; three 
used. 


of each type were 


Perceptual Techniques 


The perceptual tests included the Ror- 
schach (20), Behn-Rorschach (31), and 
Levy Movement (21) cards, all admin- 
istered and scored according to a stand 
ard procedure based on the Klopfer and 
Kelley (13) Rorschach manual. Besides 
the usual M (human), FM (animal), and 
m (inanimate) movement scores, a com- 
bined or sum movement (SM) score was 
obtained. All scores were converted to 
percentages to correct for individual dif- 
ferences in total number of responses per 
test and to provide a common base for 
comparison. 


Verbal Techniques 


The verbal techniques included two 
sentence construction procedures espe- 


* Only brief descriptions of the test procedures 
and materials are given here. Further details 
may be obtained by consulting Appendixes A 
K, pp. 68-97, of the original publication: Okar- 
ski, J. F., Consistency of projective movement 
responses. Doctoral dissertation, Columbia Uni- 
ver., 1956 (or Publication No. 17,072. Ann Ar 
bor: University Microfilms). 


cially devised for the experiment. Stim- 
ulus words for these tests were chosen to 
provide cues minimally suggestive of re- 
sponse. It was postulated that, as the 
number of cues in the stimulus material 
was reduced, the likelihood of response 
to personal cues was increased. This pro- 
cedure ostensibly gave greater assurance 
that response was more a function of the 
individual than of the stimulus material 
itself. The third verbal technique was a 
modification of Severn’s (23) Heteronym 
Test. Brief descriptions follow. 

Sentence Construction 1. The subject 
was asked to make up and write down 
as many short simple sentences begin- 
ning with the word the as he could in go 
minutes, 


idea” for 


each sentence. The test was presented as 


using a “different 
an experiment in “imagination,” and the 
subject was encouraged to “stretch” his 
imagination as much as he liked and in 
any way he wished. 

Sentence Construction 2. The subject 
was asked to compose one sentence for 
each of 4o different stimulus words like 
the, and, but, for, ete., incorporating 
these in any way he wished. Otherwise, 
instructions were substantially the same 
as those for Sentence Construction 1. 

Heteronym Test. In the Heteronym 
Test the subject was presented visually 
with 4o two-syllable words, each having 
both verb and nonverb meanings, de- 
pending on the syllable stressed. Each 
was hidden in a matrix of scrambled let- 
ter mounted on a 4” xX 6% card. The 
cards were arranged in four ordered sets 
including alternate 
nonheteronyms to 
the test. 


cards containing 
the nature of 
The cards were administered at 


mask 


intervals according to a predetermined 
plan (see Administration of the Battery). 
The subject was instructed to find the 


hidden word on each card and to say it 


aloud on doing so. 
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Scoring 

Sentence. constructions. A scoring sys- 
tem similar to that used in the percep- 
tual tests was experimentally developed. 
The method was based on adaptations 
of Rorschach scoring rules. A list of over 
goo sample sentence constructions served 
as scoring criteria, e.g.: M—“The player 
made a home run.” FM—“A cat just 
came in.” m—“The tree was struck by 
lightning.” 

All sentence constructions were scored 
accordingly; raw scores were converted 
to percentages as in the perceptual tests. 

The reliability of the scoring system 
examined by 


was the re- 


submitting 
sponses of 64 subjects on Sentence Con- 
struction 1 to two independent judges, 
one scoring the odd numbered and one 
the even numbered items. Their scores 
were then compared with those of the 
experimenter, Ninety-one percent of the 
odd numbered items were scored with 
perfect agreement; 95°; of the even num- 
bered items were scored with perfect 
agreement. 

Correlation coefficients comparing the 
scores given by the judges with those 
given by the experimenter were also 
computed, Corrected by  Spearman- 
Brown formula, the coefficients ranged 
from .gi to .g8. On the basis of these 
the the evolved 
system of scoring appeared to be ade- 
quate for experimental purposes. 

Heteronym Test. For the Heteronym 
‘Test, movement was scored in terms of 


figures, reliability of 


the subject’s pronunciation of the heter- 
onym: if he pronounced the word ac- 
cording to the verb definition, he was 
credited with a movement response. The 
proportionate number of such pronunci- 
ations was recorded as the subject's 
movement score. 

There appeared to be no basis for dif- 
ferentiating 


various subcategories of 
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movement as in the other tests; hence 
only the one index of movement was ob- 
tained. It was considered simply as a 
general indicator of movement response 
tendency corresponding most nearly, 
perhaps, with SM but suitable for com- 
parison with any other type of score. 

Since the technique was virtually selt- 
scoring and quite objective, no test of 
scoring reliability was considered neces- 
sary. 


Subjects 


Complete data were obtained for 82 
male subjects, 18 to 25 years of age. They 
were drawn from an experimental pool 
of military recruits in their sixth day of 
induction Air 
Force Base, Geneva, New York. Subjects 
were required to be at least high school 


processing at Sampson 


graduates; except for this limitation, se 
lection was by random sampling  pro- 
cedures employed by the base for its own 
research purposes. 


Subjects came different 
United States 


white 


from 17 
throughout the eastern 
Negroes; the 


states 
SIX. were 
had up to 


rest, Thirteen 


two and one-half vears of college training; 10 
were college graduates. Only one reported hav- 
ing courses in psychology; these were of a rudi 
mentary nature 
or other 


Some 


No data concerning intelligence 
diagnostic attributes obtained. 
backgrounds of the 
subjects, however, might be inferred from the 
following information about parent occupation 
skilled or semiskilled tradesmen o1 
laborers in industry, business, mining, or con 
struction; 23°; unskilled 18°; 
held supervisory or managerial positions; 9°; 
operated their own minor businesses; 5°; 


were 


notion of the social 


were 


were laborers: 
were 
farmers. Out 
side the background information given, subjects 
remained anonymous 


professional people; and 5°; were 


{dministration of the Battery 


Subjects were scheduled in pairs to 
complete the tests in one day. All tests 
except the Sentence Constructions were 
administered in individual sessions; the 


latter were given in joint sessions. Joint 


TABLE 1 
Opp-EvEN RELIABILITY COEFFICIENTS 
FOR ALL Six TESTS 


(Based on percentage movement scores 
for 82 Ss) 


Movement Category 
Test 
M FM m SM 


Perceptual 


Rorschach .56 .25 | .69 

Behn | .63 .42 .69 

Levy .36 | .49 
Verbal 

Sent. Constr. 1 .70 87 

Sent. Constr. 2 75 43 |—.02 74 

Heteronym .73 


Note. Coefficients corrected by Spearman- 
Brown formula. 


and individual administrations were al- 
ternated to permit the subject suitable 
rest periods. 

After a standardized orientation given to fa 
cilitate rapport and to dispel any examination 
set acquired by the subjects during the preced- 
ing days of classification and aptitude testing, 
the tests were given in the following order 
(a) Heteronyms, first set; Rorschach; Hetero 
nyms, second set; (b) Sentence Construction 1; 
(c) Heteronyms, third set; Behn-Rorschach; 
Heteronyms, fourth set: (d) Sentence Construc 
tion 2; (e) Levy Movement Cards, Before taking 
the tests subjects were given the option of with 
drawing from the experiment without penalty 
in order to put participation on a voluntary 
basis. Brief preliminary interviews served to ob- 
tain personal data, as reported above, just before 
administration of the first test procedure. 


Reliability of the Tests 


Percentage scores on odd-even_ split- 
halves of each test were correlated with 
each other to obtain estimates of test re- 
liability. In the case of the perceptual 
tests, scores were based on odd and even 
card groupings. In the verbal tests, scores 
were based on odd and even items. 

Table 1 presents the values obtained, 
as corrected by Spearman-Brown_ for- 
mula, Coefhcients varied widely, ranging 
from — .og to .88. In general, the verbal 
tests appeared to be more reliable than 
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the perceptual. Sentence Construction 1 
was the most reliable single test with 
values ranging from .7o to .88. The Ror- 
schach was least reliable, with r running 
from .25 to .69. 

Of the several movement indices, SM 
appeared to be the most reliable, r rang- 
ing from .53 to .87. Least reliable of the 
movement indices was m, with r running 
from — .o2 to .49, excepting the single 

.82, obtained for Sentence Con- 
struction 1. 

On the 
techniques chosen for the experiment 
did not, as a whole, appear to be highly 
reliable. As reliability coefhcients, how- 
ever, the estimates presumed the meas- 
urement of a 


value, 


the basis of these estimates, 


variable 
which was relatively stable in character. 
It was precisely this feature, the stability 
of performance, which the experiment 


psychological 


brought into question. It proposed that 
the answer to the question might be de- 
termined by observing the generality of 
the subject's performance among suc- 
cessive samples of behavior, as defined 
by each of several tests. The split-halves 
of each test, however, might also be re- 
garded as successive samples or subsam- 
ples of behavior among which the gener- 
ality of the subject’s performance might 
be observed. The generality of the sub- 
ject’s the limits 
given by split-half comparisons might 
thus be equally regarded as evidence 


performance within 


concerning the relative stability or in- 
stability of the variable within each test. 


Treatment of the Data 


It was assumed that a particular form 
of behavior represents something deep 
rooted and stable in the individual if it 
occurs repeatedly in different situations 


with such regularity as to minimize 


chance occurrence. Treatment of the 


data, therefore, hinged on some method 


6 


of classification which permitted proba- 
bility calculation. 

Classification of scores and probabil- 
ity. All percentage scores were first classi- 
fied as high or low, depending on whe- 
ther they fell above or below their re- 
spective medians as shown in Table 2. 
Scores falling close to the median were 
computed to three or more decimal 
places to eliminate ties and determine 
classification. Where 
failed to break the distribution into 
equal halves, near-median scores were 
assigned at random to equalize the two 
class frequencies. Tied scores falling at 
the median in the larger of the approxi- 
mate halves were 
number needed to 


this procedure 


serialized, and the 
fill out the smaller 
halves were chosen through a table of 
random numbers. The procedure was 
followed for all distributions otherwise 
failing of equal halves, except where the 
median fell at zero—in these cases, all 
zero scores were classified as low, and 
the rest as high. 
Of the 21 
Table 2, 12 required no random alloca- 
tions. In the remaining distributions, the 
number of scores 


distributions shown in 


allocated at random 
from the larger half ranged trom 1 to 4, 
with the average at 1.9. 

Except for the FM category in the 
Levy test and Sentence Construction 2, 
where more than half of the subjects re- 
ceived zero scores, the classification pro- 
cedure divided the sample in each move- 
ment category into two equal groups of 
high and low scoring subjects and de- 
fined equal probability (.5) for high and 
low scores in each test. In the FM cate- 
gory for the two tests just mentioned, 
proportions of high and low scoring sub- 
jects were .37 + .63 and .22 + .78 respec- 
tively, defining corresponding probabili- 
ties. Assuming each test to be an inde- 
pendent sampling of behavior, the prob- 
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ability of any high-low score pattern or 
combination in of move- 


ment could thus be computed either by 


any category 
expanding the binomial or by enumerat- 
ing all combinations and permutations 
of high and low proportions. The pro- 
cedure made simultaneously available 
(a) tests of significance for any amount 
of variation or consistency between high 
and low scores as shown by any one sub- 
ject and (b) chance expectancy values 
against which the performance of the 
group as a whole could be evaluated. 
Treatment of the data on the basis 
described involved certain dangers which 
should be noted. On the one hand, di- 
chotomizing scores at the median some- 
times defined wide limits within which 
fluctuate and 
still be regarded as consistent as long as 


the subject's scores might 


they were either above or below the me- 
dian. On the 
ject’s scores fluctuated about the median, 


other hand, if the sub- 
they were automatically defined as in- 
consistent even though they might fluc- 
tuate within a narrower range than 
scores Which otherwise qualified as con- 
The the 


data thus raised the distinct possibility 


sistent. basis for treatment of 
that consistent performance might not 
be detected in some cases and that indi- 
vidual de- 


fined, might frequently represent artifi- 


differences in variation, as 


cial distinctions rather than true differ- 
ences. 

The method thus incurred serious 
risks of error. The importance of the ex- 
perimental problem, however, appeared 
to justify some exploratory risks. In ad- 
dition, in view of the way in which the 
data were distributed, it was question- 
able whether any other method was more 
appropriate. It was decided, theretore, to 
accept the risks involved while emphasiz- 
ing that due caution might be necessary 


in interpreting the results. 
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TABLE 2 


DISTRIBUTION OF ALI 
(R: Rorschach; BR: Behn-Rorschach; LM 


PERCENT MOVEMENT SCORES 


Levy Movement; S: Sentence Construction; 


: Heteronyms; NV =82) 


M 


BR LM 


kK Om ON 


~~ 


Plan of comparison, If the experimen- 
tal hypothesis were generally true, it 


would be expected that for any category 


of movement all subjects, or a signifi- 


cantly large majority, would score e:the) 
high or low on all six tests with a regu- 
larity beyond that anticipated on the 
basis of chance. 


If the hypothesis were not generally 


true, then it would be expected that sub- 
jects would shift between the two per- 


formance levels, with high-low 


combirations showing either uniformly 


score 


3 
I 
4 
5 
2 


wide variation or individual differences 


distributed substantially according to 
chance. 
To the the 


pothesis, therefore, the high-low score 


determine status of hy- 


patterns of all subjects were classified 
and proportionately distributed in each 
category of movement according to com 
binatorial order corresponding 
probability. Chi-square tests (27) were 
then applied in each category to deter- 
mine the nature of each distribution in 
to chance. The 


relation .o5 confidence 


8 
| 
FM 
Score 
R R BR LM S, 
-99-100 
3 .96-.98 
-93-.95 
-9O-.Q2 
.87-.89 
.84-.86 
81-—.83 
.78-.80 
-72-.74 
.69 71 
.66-.08 : 
: 65 
62 2 
.57--59 3 
.54-.50 3 2 
3 
.48-.50 4 I 
I 6 I 
-42-.44 I 6 I I 
.39-.41 ° 6 2 2 
.36-.38 ° 6 5 
33> -35 2 | 12 3 
30—. 32 ° I ° I 5 
27-.29 I I | I 4 6 
.24-.26 2 ° 6 I 10 I 7 
.21-.23 4 ° 4 3 6 5 
18-.20 8 7 12 5 7 12 2 I 
o8§~.37 9 8 I 8 2 7 9 ° ° : 
-12-.14 10 11 9 5 I 4 8 5 I 
11 7 7 13 8 3 4 2 
16 19 3 21 3 4 9 4 I 
03-.05 8 12 I 14 6 3 10 38 17 
.02 15 16 7 7 5 52 36 64 
.09 25 10 18 22 03 03 .O1 
21 35 10 19 90 02 fete) 
o8 18 12 12 03 O2 


TABLE 


m 
Score 
R BR LM S; 
99-100 
96-—.98 


ao 


3 
7 
75--77 
72-.74 
66-—-.68 
63-.05 
50 62 
57--59 
54-.56 
51-.§3 
.48-.50 
-45-.47 
42-.44 
3Q-.4I 

—.38 I 


3 

I 
18—.20 I 5 3 
4 10 
12-.14 2 I 9 19 
5 5 9 10 
26-.08 12 17 8 19 
03-.05 21 23 8 6 
o-.02 42 35 35 6 


.O4 
.02 03 .10 


level was used to define the boundary 
between a chance and a nonchance dis- 
tribution. 

Supplementary analyses were under- 
taken to detect any significant trends and 
relationships in performance over the 
three verbal tests, the three perceptual 
tests, and all possible pairs of tests. 

Finally, the relation of the subject's 
variability in one category of movement 
to that in others was examined. 

Subject sampling. Comparisons were 
made for two alternate groups of sub- 
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continued) 


I 

° 

° 2 

I I 2 
° 3 
2 6 
1 2 6 
I 2 > 1 12 
I 2 3 2 
2 1 1 1 5 5 
I 3 I I 3 6 
2 4 I 1 4 11 
5 2 6 Ss 
4 4 4 ° 6 4 
5 7 4 4 ¢ 6 
4 5 3 3 
7 2 6 2 
2 

1 


7 I 3 
6 I oO 6 4 
4 2 1 6 1 
I 4 2 7 I 
I I 1 4 

4 2 3 ° 3 

30 ? I ° 2 

39 3 4 I 


jects. The first comprised all 82 subjects 
earlier. The second com- 
prised a subsample of 64 of these same 
subjects who gave a minimum of 15, Ror- 
schach or 15 Behn-Rorschach responses. 
The purpose of the alternative sampling 
was to observe the effect of error due to 


as described 


the use of percentage movement scores 
based on small response totals. 
RESULTS 


It is hypothesized that, if the concep- 
tion of movement is a function of some- 


i 
SM 
i Se R BR LM S; S; H © 
I 
-93-.95 
-go-.gQ2 
87-. 1 
° 
.30-.32 I 
-27 29 3 5 4 
G z 02 32 34 36 25 38 57 
.O4 07 02 16 16 18 12 12 
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TABLE 3 


Six-Test PERFORMANCE: PROPORTIONATE Dts- 
TRIBUTION OF H1iGH-LOW MOVEMENT SCORES 
OBSERVED AND EXPECTED BY CHANCE IN 
Each MOvEMENT CATEGORY FOR 
ALL SuBJECTS 
(N=82) 


Proportionate frequencies in each 
Move- category of movement 
ment | 


Probable 


Observed 


M, 
m, FM 
SM 


.o16 
-004 
234 
234 
004 
O16 


Sig." 


* Six degrees of freedom. 


thing deep rooted and stable in the in- 


dividual, then his level of movement 
production, as compared with that of 
other individuals, is consistent over a 
range of different test situations. Analy- 
sis of the data gave no support to the 
hypothesis as a general proposition, as 


shown by the results below. 


Six-Test Performance 

Table 3 shows the results for all 82 
subjects on the full test battery. Given 
is the proportionate distribution of high- 
low score patterns probable ob- 
served in each movement category, with 
the derived chi square and significance 
values. Individual patterns varied from 
constantly high (6-0) to constantly low 
(o-6). Only at these extremes could the 
subject's performance be regarded as sig- 
nificantly consistent at the .o5 level or 
better. Less than 4°, of the subjects in 
any movement category scored constantly 
high; less than 5°% in any instance scored 
constantly low. Distribution chi squares 
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TABLE 4 
Six-Test PERFORMANCE: PROPORTIONATE 
TRIBUTION OF H1GH-LOW MOVEMENT 
Scores OBSERVED AND EXPECTED BY 
CHANCE IN EACH MOVEMENT CATE- 
GORY FOR THE SUBSAMPLE 
(N=64) 


Proportionate frequencies in each 
Move cafegory of movement 
ment 

Probable Observed 


V, 


O- 


x" 
Sig." 


® Six degrees of freedom. 


were not significant at the .os level, in- 
dicating no great discrepancy between 
observed and chance frequencies. 

Table 4 shows a corresponding analy- 
sis for the subsample of 64 subjects 
whose Rorschach and Behn-Rorschach 
records showed response totals of 15 or 
more. High-low score patterns were dis- 
tributed in substantially the same way as 
those for the larger sample. Distribution 
chi squares were again insignificant at 
the .os level. 

Both samplings thus showed chance 
distribution of individual differences in 
variation between high and low move- 
ment scores. In these terms, it was ap- 
parent that, if the hypothesis held, it did 
so for a few cases only and not for the 
great majority of subjects. Furthermore, 
since frequencies were distributed gen- 
erally according to chance, there was no 
assurance that even these few cases were 
not accidental. 

It was also apparent from the two sub- 
ject samplings that the results of the an- 


Pika. 
10 
HL. Vv FM m rd H-L | m, | FM V FM m SM 
SM 
.024 037 037 6-0 016, .007| .031 000 047 | .047 
5-1 046 122 | .o61 122 -I 0904 .057 004 o78 .156 
4-2 .256 .207 195 207 -2 234 2907 250 203 .203 
373 303 | .232 280 280 256 “3 313) -309) .250 | .200 260 
2-4 207 105 244 183 232 -4 234) .282 172 203 .156 | .219 
1-5 150| .134 | .171 122 110 “5 004 .135 125 172 .109 | .109 
0-6 .031 | .037 037 .049 037 “6 | .010) .020) .031 O31 -O31 O31 
.50 .go .10 5° -5° -75 


alysis were not seriously affected by 
either the inclusion or exclusion of sub- 
jects with low response totals. Succeed- 
ing analyses revealed similarly duplicat- 
ing results for the two samples; for this 
reason, and because the samples were 
not otherwise independent, only the re- 
sults for the larger group are hereafter 
presented, 

To determine whether the few cases 
who seemed to be consistent represented 
the hypothesized phenomena, the data 
for the six tests were analyzed further to 
detect any supportive trends. For this 
purpose the high-low score combinations 
of all subjects were redistributed ac- 
cording to the degree of variation or 
maximum intertest agreement 
agreement represented. In effect, this 
procedure merely served to combine dis- 
tribution frequencies for corresponding 
extreme intervals as shown in Table 3. 
Thus, proportionate frequencies for in- 
tervals 6-0 and 0-6 were combined into a 


and dis- 


single interval representing six tests in 
agreement; frequencies for intervals 5-1 
and 1-5 were combined in a single inter- 
val representing five tests in agreement, 
etc, Chi-square tests were then applied as 
before. 

Only in the m category was a trend in 
the hypothesized direction observed. 
Roughly 9% of the subjects, as com- 
pared to an expected 3°%, 
cantly consistent with all 
agreement on 


were signifi- 
six tests in 
movement level. 


About 269%, as compared to an expected 


score 


19°, Showed five tests in agreement. The 
remaining proportions fell below the ex- 
pected values. The chi 


square was 11.46, significant at the .oo1 


distribution 


level. Thus, there was no support for the 
hypothesis except in m production. 

For a still coarser analysis the number 
of subjects in each movement category 
who were significantly 


consistent (six 
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tests in agreement) were compared with 
the number who were not significantly 
consistent (three to five tests in agree- 
ment). This involved combining propor- 
tionate frequencies for intervals 6-o and 
0-6, as shown in Table g, in one cell and 
combining trequencies for the remaining 
intervals in a second cell. Chi square was 
then computed to determine whether the 
observed number of significantly consis- 
tent subjects exceeded chance expec- 
tancy. Again only in m were the results 
significant. Chi square with Yates’ cor- 
rection was 6.2 with a probability of .oz. 

On the basis of the coarser analysis, 
the hypothesis appeared to be confirmed 
for a small number of subjects on m pro- 
duction, and was rejected for the rest. It 
might be concluded that the conception 
of movement can be safely assumed to 
represent some intrinsic, stable variable 
for a small number of subjects only, and 


then only with 


respect to inanimate 


movement responses. 


Supplementary A nalyses 


It was apparent from the previous re- 
sults that the subject's movement score 
generally varied from test to test. A ques- 
tion thus arose as to the roles played by 
specific tests or types of tests in deter- 
mining the outcome of the experiment. 
Analysis was therefore narrowed to the 
areas of performance defined by the 
three verbal tests, the three perceptual 
tests, and all possible pairs of tests. 


Three-Test Performance 


The high-low score patterns for each 
set of three tests were examined exactly 
as were the data for the six tests. Only 
for the perceptual tests were the results 
significant, as shown in Table 5 which 
gives the proportionate high-low score 
distribution in-each movement category. 


\bout 17° to 22% of the subjects 


| 
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scored constantly high; about 20° to 
23% scored constantly low. All these 
proportions were greater than chance 
values, while 
tervals were 
squares were 


those for intervening in- 
lower. Distribution chi 
all significant at the .o1 
level or better. It was thus apparent that, 
for every movement category, signifi- 
cantly large numbers of subjects were 
consistent in level of movement produc- 
tion on the perceptual tests. 

Combining distribution values accord- 
ing to the maximum intertest agreement 
represented by high-low score combina- 
tions, it may be seen that the probability 
for consistent performance in any one 
movement category was .25. In other 
words, perceptual test samplings did not 
provide a-crucial test as to the signifi- 
cance of any one subject's performance. 
Hence, while significantly large numbers 
of subjects were consistent in these tests, 
it could not be said that any subject was 
significantly consistent at the standard 
.o5 confidence level. 

Trends in the hypothesized direction 
were nevertheless evident for every 
movement category. In this respect, the 
results for the perceptual tests contrasted 
with those for the verbal tests. It might 
be concluded that performance in these 
tests gave more support to the hypothe- 
sis of consistency in movement produc 
tion and that the conception of move- 
ment was more likely to be a function of 
something deep rooted and stable in tests 
of this character, perhaps, than in those 
of the verbal type. It appeared unlikely, 
however, even on these terms, that the 
hypothesis could hold equally for all or 


even a majority of subjects. 


Paired-Test Comparisons 


Using tables, 


four-fold contingency 
coefficients and chi squares were 
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TABLE 5 
PERCEPTUAL TESTS: PROPORTIONATE DISTRIBU- 
TION OF H1GH-LOoW MOvEMENT Scores 
SERVED AND EXPECTED BY CHANCE IN 
EacH MoveMENT CATEGORY 
(N =82) 


Proportionate frequencies in each 
category of movement 


Move- 
ment 


Probable Observed 


® Three degrees of freedom. 


computed to determine interrela- 
tionship of high and low scores in each 
category of movement for all possible 
pairs of tests. Table 6 shows the results. 
Coefficients ran uniformly low, ranging 


from .41 to — .27 


with 19 out of 60, or 
nearly a third, on the negative side. All 
together, only g showed significant inter- 
relationships in performance. 

Significant phi values were largely 
confined to the perceptual tests, as might 
have been expected from the results for 
three-test comparisons. Performance on 
the Rorschach was significantly related 
to that on the Behn-Rorschach in every 
movement category and to that on the 
Levy Movement Cards in the categories 
M and m. In contrast, there were no sig- 
nificant relationships between the Levy 
and the Behn, though all phi values 
were positive. There were no significant 
relationships between any two verbal 


tests and few for verbal-perceptual pair- 


ings. 
It is notable that, while the only sig- 
nificant in six-test 


result observed per- 


formance was in m, paried-test compari- 


H-L | m, | FM M FM m SM 
SM : 
3-0 125 og! .220 .220 
2-1 375 341 250 232 - 39° 250 
1-2 375 -409 354, .207) .280 
O-3 125 Iso 232 .220 
x? 12.63 (13-83 |15.04 [15.63 
Sig." .005) .005 
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sons showed most of the nine significant 
phi values in M. Included were the only 
significant relationships observed in ver- 
bal-perceptual comparisons; one of these, 
however, was significantly negative: 
— .27 for the Levy vs. Sentence Construc- 
tion 2. 

It may be concluded from these and 
from the foregoing results that, if the 
conception of movement bears any sig- 
nificant relationship to psychological 
processes in the individual for more than 
a minority of subjects, then the relation- 
ship is largely specific to certain tests or 
types of tests and that performance is 
not generally predictive from one type 
of test to another for any individual. 


Intercategory Comparisons 


Results of the experiment showed the 
presence of individual differences in var- 
iation between high and low movement 
scores. These diflerences were so distrib- 
uted that the hypothesis was, in general, 
only tenuously upheld for some subjects 
-and not for others within each move- 
ment category. Iwo further questions 
thus suggested themselves: (a) If move- 
ment scores were not themselves gener- 
ally stable so as to justify the assumption 
that something deep rooted and stable 
was reflected, was there anything to sug- 
gest that something of an intrinsically 
stable character was represented by indi- 
vidual differences in variation? (b) Since 
the experimental hypothesis was upheld 
(even though tenuously) for some sub- 
jects in each movement category, was 
there anything to suggest selective con- 
sistency with possibly stable individual 
differences generally defined on the basis 
of the specific category or categories in 
terms of which 


consistent tendencies 


were selectively expressed? 


several 


Comparisons between the 
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movement categories were undertaken in 
the hope that some answers to these 
questions might be obtained. 


Individual Differences in Variation 


It is hypothesized that, if individual 
differences in variation between high 
and low movement scores represent in- 
trinsically stable characteristics, then the 
degree of variation shown by the subject 
in one category of movement is consis- 
tent with that shown in other categories 
of movement. 

To examine the hypothesis, the data 
were first treated as in paired-test com- 
parisons, except that movement cate- 
gories instead of tests were paired, and 
corresponding individual differences in 
variation, instead of classified movement 


rABLE 6 


ParreD Tests: Pat VALUES FOR PAIRED- 
Test COMPARISONS 


(R: Rorschach; BR: Behn-Rorschach; LM: Levy 
Movement Cards; S;: Sentence Construc- 
tion 1; Se: Sentence Construction 2; 

H: Heteronyms; N =82) 


Movement category 
Paired tests 


VM FM m SM 

Verbal 

S,-S2 - .00 .12 .07 

S:-H —.02 | —.12 .02 | —.07 

S.-H —.12 .06 | —.07 | —.17 
Perceptual 

R-LM 

Verbal- 

Perceptual 

02 02 .07 

S,-LM 07 | —.02 | 02 

S.-R —.07 | —.06 .17 | —.12 

S.-BR .02 | .OF | 

S.-LM —.27*| —.10 | oy | 

| 

H-R | .02 

H-BR 27°| —.12 .02 .07 

H-LM .02 | —.06 .07 


* Significant at the .os level as indicated by chi 
square with one degree of freedom. 
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TABLE 7 


INTERCATEGORY COMPARISONS: PROPORTIONATE 
DISTRIBUTION OF SUBJECTS, PROBABLE AND 
OBSERVED, ACCORDING TO THE NUMBER OF 
MOoOveMENT CaTEGORIES—M, FM, or m 
IN WHICH THE SuByECT WAS RELATIVELY 

CONSISTENT ON THE FULL Bart- 
TERY OF TESTS 


(N = 82) 
| > ¢ > » 
Ne of | Proportionate frequencies 
oe Probable Observed 
3 | .029 .073 
2 | .198> | .122>} 646 
I | .444 
° .328 | .353 -353 
Sig. | 


* Three degrees of freedom. 
> One degree of freedom. 


scores, were plotted against each other in 
contingency Individual  differ- 
ences in variation were defined by the 


tables. 


maximum interest agreement shown in 
high-low Chi 
squares were then computed to deter- 


score combinations. 
mine whether degree of variation in one 
category of movement was significantly 
related to that in others, for the verbal 
tests, the perceptual tests, and the full 
battery. 

Chi squares were significant for M to 
SM comparisons only. Excepting these 
two categories, therefore, there was no 
indication that individual differences in 
variation were significantly related from 
category to category. The hypothesis was 
thus rejected as a general rule. Inspec- 
tion of raw score data indicated that the 
connection between M and SM_ indices 
was largely a function of part-whole 
score relationship and so offered no ex- 
ception to this conclusion, 

The the part- 
whole score relationship was most clearly 
evident 


nature and effect of 
in the Heteronyms, Sentence 


Construction 2, and Levy 


Movement 
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tests. In the Heteronym Test, FM and m 
responses were not differentiated; only 
the general, SM obtained. 
Since the SM score was entered into all 
comparisons, the subject’s M and SM 
scores were necessarily identical. Similar 
situations the Sentence 
Construction 2 and Levy tests because 
relatively few FM and m responses were 
evoked. Since the subject’s M and SM 
scores were thus identical—or nearly so— 
in three of the six tests, individual dif- 
ferences in variation for both movement 
categories were heavily biased toward 


score Was 


obtained for 


duplication. The significance of the re- 
lationship between them, therefore, was 
more indicative of limitations in the test 
procedure than of intrinsically stable 
characteristics in the individual. 
Extending the analysis, all subjects 
were classified and distributed according 
to the number of categories in which 
movement production level was_rela- 
tively consistent. Since SM was not inde- 
pendent of all three common categories 
-M,FM, and m—it was excluded, which 
allowed a range of distribution from o to 
3. For the full battery, performance was 
considered relatively consistent if five to 
six tests were in agreement; for both ver- 
bal and perceptual techniques, agree- 
ment among all three tests was required 
to meet the criterion. Exact probabilities 
were computed for each distribution in- 
terval by combining and permuting pro- 
portions observed to be relatively con- 
within each 
category. A chi-square test of each dis- 


sistent, as defined above, 
tribution was then made to detect any 
significant discrepancy between probable 
and observed frequencies. 

Only the full battery revealed any sig- 
nificant shown in 
Table 7, giving probable and observed 


distributions for both grouped and un- 


results. These are 


grouped intervals. Observing the un- 
grouped data, it may be seen that about 
7° of the subjects were, in fact, rela- 
tively consistent in all three movement 
categories, in comparison to a probable 
proportion of .ozg. The data thus showed 
that a limited number of subjects were, 
in fact, generally consistent in level of 
movement production beyond the like- 
lihood of chance-determined perfor- 
mance at better than the .o5 level of con- 
fidence. 

The distribution chi square was 8.03, 
significant at the .o5 level. Since the re- 
maining observed proportions were rela- 
tively close to or below the expected 
values, it might be inferred that the 
number of subjects who were generally 
consistent was significantly greater than 
zero, even though small in absolute 
terms. 

No other significant inferences could 
be drawn from these results. The hy- 
pothesis was thus tenable on a limited 
basis only. It might be concluded that 
individual differences in variation repre- 
sented something of a stable character 
only for a small but significant number 
of subjects who were generally consis- 
tent in level of movement production. It 
might also be asserted that on the basis 
of these intercategory comparisons the 
limited and tenuous support found 
earlier for the original experimental hy- 
pothesis was confirmed and strength- 
ened, and that the conception of move- 
ment in all three common categories, M, 
FM, and m, might well represent some- 
thing deep rooted and stable for certain 
extreme cases, though not for the great 
majority of subjects. 


Selective Consistency 


It is hypothesized that if deep rooted 
and stable individual diflerences are ex- 
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pressed in terms of selective consistency, 
then all or a significantly large majority 
of subjects are relatively consistent in 
some one or more of the several move- 
ment categories. 

It may be seen from the grouped data 
in Table 7 that a majority, or about 
65°, of the subjects, were relatively con- 
sistent in 1 to 3 movement categories; 
35° Were consistent in none. Chi square 
was .23, indicating that these propor- 
tions were almost exactly what was ex- 
pected by chance. 

There was thus no support for the 
hypothesis, even though a majority of 
subjects were consistent in one or more 
movement categories. Results obtained 
separately for the verbal and perceptual 
tests, not shown here, failed similarly 
to support the hypothesis. It was con- 
cluded that neither for the verbal, the 
perceptual, nor for the full battery of 
tests was it possible that intrinsically 
stable individual differences were de- 
fined in terms of selectively consistent 
tendencies favoring some one or more 
movement categories. 


Summary of Results 


The over-all performance of the sub- 
jects on the full test battery failed to 
support the hypothesis of consistency as 
a general proposition. Analysis showed 
the presence of widely distributed indi- 
vidual differences in variation between 
high and low movement scores for every 
category of movement. In these terms, 
the hypothesis was tenuously upheld, in 
most movement categories, for some few 
subjects only. 

Some exception was apparent in m 
production where a small but significant 
number of subjects were significantly 
consistent. It was concluded that the con- 
ception of movement might safely be 
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assumed to represent something deep 
rooted and stable for a small number of 
individuals only and then only with re- 
spect to m production. 

Intercategory comparisons of individ- 
ual differences in variation, however, re- 
vealed a small! but significant number of 
subjects who were generally consistent 
in all three common categories, M, FM, 
and m. On this basis, the above conclu- 
sion was somewhat strengthened and 
broadened to suggest that the conception 
all three categories 
might well represent something deep 


of movement in 
rooted and stable for certain extreme 
cases, though not for the great majority 
of subjects. Otherwise, individual differ- 
ences in variation gave no evidence of 
intercategory stability so as to suggest 
that these differences might define some- 
thing of a psychologically significant, 
stable character in the individual. There 
was also no evidence that stable indi- 
vidual differences might be defined in 
terms of selectively consistent tendencies 
favoring some one or more movement 
categories. 

When trends and relationships among 
specific tests or types of tests were con- 
sidered, positive results were confined al- 
most exclusively to the perceptual tests. 
These showed trends in the hypothesized 
direction for every movement category. 
It was concluded that, if the conception 
of movement was a function of some- 
thing deep rooted and stable in the in- 
dividual, then it was more likely to be 
observed in tests of the perceptual than 
of the verbal this 
basis, it could not be assumed to hold 


type; but even on 
equally for all or even a majority of sub- 
jects. 

Paired-test comparisons showed that 
trends among the perceptual tests were 


largely confined to significant relation- 
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ships between the Rorschach and Behn- 
Rorschach. All paired-test relationships, 
however—perceptual, verbal, and verbal- 
perceptual—were of a low order. It ap- 
peared that, if the conception of move- 
ment was related to something deep 
rooted and stable for more than a minor- 
ity of subjects, then the relationship was 
largely specific to certain tests or types 
of tests and that performance could not 
be regarded generally predictive from 
one type of test to another for any indi- 
vidual. 


DISCUSSION 


Is the movement response generally 
stable? The answers suggested by previ- 
ous studies might be summarized as fol- 
lows: that the movement response is (a) 
generally stable, (b) generally unstable, 
(c) stable under certain conditions and 
unstable under certain conditions, (d) 


stable for some individuals or groups but 


not for others. 

Under the more or less varied condi- 
tions represented by the different tests 
used in the present study, the experi- 
mental results might be said to agree 
that the movement response is not gen- 
erally stable. They appeared to suggest, 
further, that the status of the movement 
response may vary depending on factors 
inherent in both subject sampling and 
the conditions under which the subject's 
movement responses are observed. The 
results might best be discussed, therefore, 
from the standpoints of the basic com- 
ponents of each of these sources of vari- 
ation: (a) the individual and (b) the tests 
or types of tests used to sample his uni- 
verse of movement responses. Some fur- 
ther implications may then be drawn in 
relation to general theory and practice 
in the projective techniques. 


q 
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The Movement Response in Relation to 
the Individual 

The results of the experiment sug- 
gested that when the individual is re- 
garded as an independent universe of 
behavior and suitable tests of signifi- 
cance are applied to his performance 
over a range of diflerent test situations, 
the conception of movement may well 
represent a significantly consistent vari- 
able for certain subjects. In these terms, 
the experimental results gave partial 
support to the predictions expressed by 
Wittenborn (28), Sanford (22), and 
others and encouraged the belief that 
the movement 
under a variety of different conditions 


response as observed 
or tests may well represent an intrinsic 
ally stable personal variable for some in- 
dividuals or groups. 

All three 
gories—M, FM, and m—appeared to have 


movement response cate- 


personal relevance these limited 
terms. The weight of evidence, however, 
was such as to emphasize most strongly 
that none of the commonly observed 
movement categories may be safely as 
sumed stable and, hence, personally rele- 
vant for all individuals or groups in any 
or all test situations, including tests such 
as the Rorschach. 

Question might be raised, however, as 
to whether the implication noted was 
not purely a function of the experimen- 
tal method used. It may be recalled that 
a weakness of the method, as discussed 
earlier, was the possibility that consis- 
tently performing subjects might fail to 
be detected if their scores fluctuated 
about the median. It is entirely possible 
that in confirming the hypothesis of con- 
sistency for some subjects and not for 
others the experimental method merely 
pointed out those whose scores were, on 


the average, either more or less extreme 
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rather than more or less consistent. Due 


caution, thus, urged verification of the 
finding by further research. 

While the experimental results did 
that the 
movement response might be generally 


not foreclose the possibility 


stable, they strongly discouraged such a 
possibility. In so doing, they followed a 
pattern common to a number of studies 
in which intor- 
the 
stability or the validity of the movement 


some etlort—lformal or 


mal—was made to examine either 
responses and/or derived indices on the 
basis of the individual as well as group 
Milton (18), for 
both the M 
M:C ratios on the Rorschach were stable 


for only 


statistics. example, 


found that 


scores and the 


about a third of his subjects 


whether retested under experimentaly 


induced set or under standard condi- 
tions. Using backward and forward test- 
retest Rorschach administration, Rabin 
and Sanderson (19) found the M:C ra- 


tios stable for 80°; of their subjects and 


unstable for the rest. Thornton and 


Guiltord (25) found split-half agreement 
for M:C tor 
Altus and Thompson (3) used a stand- 


only 55°, of their subjects. 
ard administration of the Rorschach and 
found that, while consistent relationship 
intelli- 
gence held “almost invariably” for sub- 


between M scores and a test of 
jects whose movement scores were high, 
it failed to hold 


whose scores were low. 


generally for those 
The results of the 
present study, together with some of the 
more careful studies reported in the lit- 
erature, thus strongly suggested that the 
movement responses and derived indices 
may be personally relevant for some in- 
dividuals or groups but not for others 
and, further, that this conclusion may 
hold the move- 
ment responses are observed on an intra- 


regardless ot whether 


or intertest basis and whether constant 


or varied conditions are maintained. 

It might also be asserted on the basis 
of the studies cited that, in confirming 
the hypothesis of consistency for some 
subjects but not for others, the general 
pattern of results yielded by the present 
study was not unique to its experimental 
approach. Thus, while due caution on 
the grounds described earlier strongly 
urged further there ap- 
peared to be no reason why the findings 
should not be tentatively accepted. 

Experimental and practical tmplica- 
trons. If the findings are indeed correct, 
they may help to understand the con- 
flicting and otherwise inconclusive im- 
plications generally reported on the basis 
of group results alone. For if the move- 
ment responses are stable or relevant for 


verification, 


some individuals or groups but not for 


others, then, apart from any _ other 
sources of error, the positive or negative 
results observed in a given study may 
simply reflect the vagaries of unwittingly 
selective subject sampling. Considered in 
this light, the widely varied estimates 
sometimes reported for both the relia- 
bility and validity of the movement re- 
sponses may not reflect as much on the 
doubtful nature of the evidence as on 
its sampling limitations. 

The crucial question with respect to 
the reported findings may thus be not so 
much whether the movement responses 
provide dependable indices to personal- 
ity and behavior but, rather, for whom? 
Practical considerations would thus seem 
to demand re-investigation of the find- 
ings under individual-oriented —proce- 
dures to identify, if possible, those types 
of individuals or groups for whom the 
movement responses may salely be as- 
sumed relevant and to provide a discre- 
tionary basis for clinical interpretation. 
The present study offered no basis for 
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testing any interpretive hypothesis such 
as might prove valid within the limits 
suggested. Those hypotheses in terms of 
which some significantly positive results 
have been reported, however, might be 
considered plausible: Altus and Thomp- 
(3), Tucker (26), and others have 
found significant but low relationship 
between Rorschach movement indices 
and intelligence. Singer, Meltzoff, and 
Goldman (24), Meltzoff and Levine (16), 
and others found some significant rela- 
tionship between Rorschach movement 
responses and 


son 


moto! inner 


control, and fantasy. Altus (2) and others 


inhibition, 


have reported positive relationship be- 
tween Rorschach movement indices and 
evidences of maladjustment and psycho- 
pathology. 

It remains to be established, however, 
lor what classes of subjects these studies 
may offer dependable clinical hypothe- 
ses. From the nature of its subject sam- 
pling and the results of the present 
study, it might only be inferred that the 
movement responses given by subjects 
from some ostensibly normal or nonpsy- 
chiatric groups may rarely be found sufh- 
ciently consistent to warrant any kind of 
interpretation. It might be inferred fur- 
ther that, pending identification of the 
sampling characteristics or other con- 
venient which 
might define the psychologically signifi- 


discriminative criteria 
cant populations, the clinician may have 
no assurance that any interpretation of- 
fered in a particular case actually relates 
to anything typical of the subject. 
Indices of variation as diagnostic vart- 
ables. A number of investigators have 
suggested that not only the consistency 
but the inconsistency and perhaps indi- 
vidual differences in amount of variation 
observed in clinical or test behavior may 
serve to identify or discriminate signifi- 


i 
i 
il 
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cant classes of individuals and personal- 
ity variables. Thus Hutt, Gibby, Milton, 
and Pottharst (10) and others suggested 
that the relative consistency or inconsis- 
tency of the Rorschach scores might dif- 
ferentiate, respectively, the “rigidity” of 
the abnormal subject from the “capacity 
to shift” or flexibility of the normal. 
Dorken (5) suggested modifications on a 
similar hypothesis depending on whether 
individual differences in variation were 
observed on an intra- or intertest basis 
involving projective techniques of differ- 
ent types. 

The crucial question with regard to 
any proposals of this character is whe- 
ther or not individual differences in 
variation are themselves generally stable 
and thus define true differences and not 
merely chance distinctions. Reviews of 
the literature on projective techniques 
reveal no effort to deal with this impor- 
tant question. The present study offered 
implications relating to the problem in 
terms of intercategory comparisons of in- 
dividual differences in variation between 
high and low levels of movement pro- 
duction. The using this 
method of observing individual differ- 
ences in 


danger of 
variation has already been 
noted. In the absence of any previous 
effort to deal with the problem of their 
stability in the projective techniques, 
however, the tentative results may be of 
considerable interest. 

The results suggested that individual 
differences in variation were not signifi- 
cantly related from one area of perform. 
ance to another, and that there was no 
basis for assuming that the differences 
were of general psychological import or 
that they defined a psychologically sig- 
nificant class of subjects or personality 
variables in any instance—except where 
the subject's performance was generally 
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consistent. 


The results thus offered no 
support among the movement indices for 
any proposals of the character suggested. 
At the the results warned 
against making any diagnostic inferences 


same time, 
on the basis of individual differences in 
variation without first checking on the 
stability of those differences. 

The data did not preclude the possi- 
bility that individual differences in varia- 
tion 


might be of a character 


within specified areas of performance as 


stable 


defined, for example, by each of the 
several categories of movement examined 
in the present study. It is not inconceiv- 
able that interpretive inferences might 
be warranted on such a basis. Confirma- 
tion of this possibility in the present ex- 
periment, however, would have required 
replication of the experiment with the 
same subjects and was beyond its scope. 
The possibility thus remains for further 
investigation. 


The Movement Response in Relation to 
the Test on Type of Test 

While the over-all the ex- 
periment suggested that interpretation of 
the movement responses given by osten- 


results of 


sibly normal subjects may be justified 
for some few cases only, subsidiary an- 
alyses suggested that the number might 
be expected to vary depending on the 
test or type of test used. Of the two types 
of tests used in the experiment, the per- 
ceptual tests appeared to offer the greater 
promise for discriminating substantial 
numbers of such subjects. This implica- 
tion was evident on the basis of the posi- 
tive trends observed in the perceptual 
tests, as contrasted with the negative re- 
sults among the verbal tests. It might be 
concluded that the perceptual tests some- 
how impose conditions on the subject's 
performance which are more conducive 
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to tapping the deeper rooted, more basic 
aspects of personality and behavior as re- 
lated to the movement response and, ac- 
cordingly, possess more in common as 
measures of movement response ten- 
dencies. 

Of the three perceptual tests, the Ror- 
schach and Behn-Rorschach appeared to 
enjoy greater mutual relationship in the 
area of movement production than any 
other pair. Their mutuality appeared to 
extend through every movement cate- 
gory, including sum movement—which, 
incidentally, appeared to be the most 
stable of the several indices in this rela- 
tionship, whether observed on an intra- 
or intertest basis. It may be noted that 
Epstein, Nelson, and Tanofsky (7), using 
their extensive series of new inkblots, 
similarly found sum movement to be the 
most reliable of the movement indices. 
The results of this as well as of the pres- 
ent study might be considered to support 
those authorities who insist that im- 
portant information may be overlooked 
in scoring only the human movement 
responses. The results would suggest, fur- 
ther, that if preference is to be given to 
any one index, it should perhaps be given 
to sum movement and not to human 
movement. 

Considering the phi values obtained in 
the present study, however, in relation to 
correlation coefficients of comparable 
grade and in relation to the reliabilities 
of the two tests, there would appear to 
be some justification for regarding the 
relationship between the Rorschach and 
Behn-Rorschach to be approximately 
unity in all categories of movement when 
corrected for attenuation. (Incidental 
computations, in fact, confirmed this pos- 
sibility.) There thus appeared to be no 
theoretical ground for preference be- 
tween movement categories as far as these 


two tests are concerned. It might be con- 
cluded that the two tests offer essentially 
common measures limited in their in- 
terrelationship in the several categories 
of movement only by their variously low 
relabilities. While this finding encour- 
aged acceptance of the tests as theoretic- 
ally parallel forms for observing move- 
ment production, it would seem doubt- 
ful whether in their present state they 
can be reliably used as such in individual 
cases. In stressing this limitation, the re- 
sults of the experiment essentially agreed 
with those reported by Eichler (6) and 
others for the two tests generally. 

Similar but somewhat narrower conclu- 
sions appeared warranted concerning the 
Rorschach and Levy Movement Cards on 
the basis of their significant but low in- 
terrelationship in the M and m cate- 
gories. It is notable that previous com- 
parisons between these two tests have 
vielded no significantly positive results. 
\ssessing their own investigations in this 
respect, King (12), and Allen, Ray, and 
Poole (1) suggested that the negative 
findings might have been due to the 
marked differences in the instructions 
for the two tests. The results of the pres- 
ent experiment would support such a 
conclusion and suggest that the two tests 
do have some mutual validity when less 
structured directions are substituted for 
the standard form prescribed for the 
Levy test. 

The contrasting results observed for 
the two types of tests, perceptual and 
verbal, lead to some speculation concern- 
ing the possible causes. Most readily ap- 
parent is the fact that the contrast did 
not appear to be due to differences in 
reliability between the two types of tests. 
The results were, in fact, contrary to 
what might have been predicted on these 
grounds, since the verbal tests were on 
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the whole more reliable than the per- 
ceptual tests. 

Apparently, the stability of the move- 
ment responses as observed in the per- 
ceptual tests is sufficiently great as to 
make itself evident (for some subjects) 
despite the low reliability of the tests. If 
so, then the development of more ade- 
quate tests of this character, possibly 
along the lines suggested by Barron (4) 
might greatly expand their discrimina- 
tive value. This possibility suggested it- 
self most strongly in connection with the 
m responses which, despite being least 
reliable, revealed significantly positive re- 
sults not only with respect to perform- 
ance in the perceptual tests, but also for 
the full battery. It is conceivable that 
a successful effort to raise the reliability 
of the m category could make it the most 
generally significant; some special study 
may well be due this category of move- 
ment. 

As to the possibility of raising the re- 
liability of any of the movement indices, 
it is interesting that the results obtained 
by Epstein, Nelson, and Tanofsky (7) 
discouraged the feasibility of substan- 
tially improving reliabilities in the ink- 
blot tests by lengthening the stimulus 
card series within practical limits. It 
might be added that if the results of the 
present study can be accepted as indica- 
tive, then it may not be possible to raise 
reliabilities enough in tests of this type 
to permit individual prediction in any 
case except with reference to specific 
populations, 

Except for the FM and m categories 
in Sentence Construction 2, reliabilities 
in the verbal tests appeared high enough 
to suggest that the tests might very well 
measure internally consistent tendencies 
of some sort. Apparently, however, the 
conditions imposed on the subject's per- 
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formance by these tests were not condu- 


cive to tapping such deep rooted and 


stable tendencies as might—except for 


some few subjects—generalize 


the 


broadly 
from the 
verbal to the perceptual tests. Or, if 
basically 


either among verbal or 


indeed 
sampled, then the functions must be as- 
sumed 


stable functions were 


generally independent of each 
other and of any sampled by the per- 
ceptual techniques. 

Doérken (5) that different 
types of projective test materials or tasks 
might tap different levels of personality 


suggested 


structure. He asserted on this basis that 
projective techniques might be expected 
to vield mutually consistent results only 
when (a) the tests are of the same or of a 
similar type and hence measure on the 
same level of personality or (b) when the 
different levels of personality tapped by 
different types of tests are themselves con- 
sistently organized—a condition he con- 
sidered likely only for normal subjects. 

The general lack of agreement between 
the verbal and perceptual tests in the 
present experiment might partially, per- 
haps, be understood on Dorken’s (5) 
terms. Failure of the majority of the sub- 
jects to be consistent within either of the 
two types of tests, however, is not so eas- 
ily explained. It might even be concluded 
from this result that, quite contrary to 
Dorken’s (5) principles, the projective 


techniques may measure on different 
levels of personality regardless of whether 


the same or different types of stimulus 


materials and/or tasks are employed. 
Some investigators have, in fact, sug- 
gested that the projective techniques 


may sample different levels of personal- 
itv structure even within the confines of 
a single test, depending on the subject. 


Mactarlane and Tuddenham (14) have 


noted this possibility as, perhaps, a mayor 


| 
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problem inherent in all projective tech- 
niques and a key question in relation to 
general theory and _ practice. 


Implications for General Theory and 
Practice 

Among the basic assumptions com- 
monly accepted as logical consequences 
of the relatively unstructured nature of 
the projective techniques, Macfarlane 
and Tuddenham noted the following: 
(a) “... a belief that the psychological 
determinants of each and every response 
the be- 
lief that projective techniques tap the 


are basic and general.” (b) 


durable essence of personality equally in 
different individuals” (14, p. 34). As 
against these assumptions, the authors 
noted that nonprojective psychology has 
long recognized test behavior as partially 
determined by peripheral and transitory 
factors. On their own account, they cited 
unpublished materials suggesting that, 
while the protocols of some subjects 
dwelt more on the basic and enduring 
levels of personality, others dwelt more 
on superficial levels and sometimes re- 
vealed only the protective coverings. In 
confirming the hypothesis of consistency 
for some subjects but not for others, the 
results of the present experiment easily 
lent themselves to similar interpretation, 
suggesting that the movement responses 
in a given projective test might well re- 
late to basic, enduring levels of personal- 
ity for some subjects but only to pe- 
ripheral and transitory aspects for others. 

The results of the experiment thus 
joined in suggesting that one of the im- 
portant consequences of using relatively 
unstructured techniques may be that the 
subject is tree to determine, consciously 
or unconsciously, by his own immediate 


set the level of personality on which he 
responds and, thereby, to limit the rela- 
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tion between his performance and basic 
aspects of personality and behavior. 
Such an interpretation, however, in- 
volves acceptance of a prior assumption: 
that the test invariably samples person- 
ality functions even when the subject's 
performance departs from a basic frame 
of reference. Tudden 
ham have expressed it as an explicit 
principle in “The Assumption of Re- 
sponse Determination.” That is, “. . . that 


Macfarlane and 


every subject's responses are not the con- 
sequence of sheer accident but are de- 
termined by psychological attributes of 
that subject” (14, p. 33). This statement 
is comparable to that offered by Zubin 
and Young, namely that the test 
behavior itself is a small sample of life 
behavior and not a random inexplicable 
performance” (30, p. 2-5). Macfarlane 
and Tuddenham (14) stressed the princi- 
ple as a statement of scientific determin- 
ism, which few psychologists would be 
likely to question. Zubin and Young (30) 
emphasized it as a postulate which de- 
mands proof. 

It may be noted that the principle as 
expressed in both statements predicates 
the personal relevance of all classes of 
projective test performance ona hypoth- 
esis of nonchance behavior. Treatment 
of the data in the present study offered a 
test of the hypothesis and, thereby, of 
the principle itself, in relation to the 
movement responses. The results showed 
that only for a very small number of 
cases did the movement responses occur 
with 


suc h 


regularity as to minimize 


chance occurrence. It 


might be con- 
cluded accordingly that the movement 
responses might very well be “deter- 
mined” by chance for some and even the 
great majority of subjects in certain 
groups. By the same token, it might seri- 


ously be questioned whether the non- 


chance hypothesis and, with it, the as- 
sumption of response determination can 
be accepted, without qualification, as 
generally valid for all classes of projec- 
tive test behavior. 

One of the most important implica- 
tions of the experiment was thus to stress 
the need for basic research on the projec- 
tive techniques with a view toward ulti- 
mate verification or revision of their 
commonly accepted theoretical founda- 
tions. The results of the present study 
suggested that a safer premise for observ- 
ing projective test behavior might be the 
proposition that the subject's responses 
may or may not be “determined” by 
chance. Pending reversal of this implica- 
tion by further research, it might be con- 
cluded that the interpretation of the 
movement responses and, perhaps, other 
classes of projective test behavior, as well, 
may not be justified without establish- 
ing in the individual case that the sub- 
ject’s responses actually occur in accord- 
ance with nonchance principles. Meas- 
ures of intra-individual consistency based 
on multiple or battery testing may thus 
prove to be indispensable for both ex- 
perimental and clinical purposes. 


SUMMARY 


The purpose of the experiment was to 
examine the assumption that the move- 
ment response as observed in projective 
tests represents something basically stable 
in the individual's personality and_be- 
havior. 

It was hypothesized that, if the assump- 
tion is the individual's 
comparative level of movement produc- 


tenable, then 


tion is consistent over a range of different 
test situations. 


The hypothesis was examined on the 
basis of the percent human (.M), animal 
(FM), inanimate (m), and sum movement 
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(SM) scores obtained by 82 ostensibly 
normal male military recruits, 18 to 25 


years old, on a battery of three percep- 
tual and three the Ror- 
schach, Behn-Rorschach, Levy Movement 
Cards, 
tests, 


verbal tests: 


two new Sentence Construction 
and a of Severn’s 
heteronym technique. The data in each 
category ot 


modification 
movement were first exam- 
ined for evidence of significant interest 
agreement on whether the subject scored 
consistently above or below the median 
on the full battery of tests. Supplemen- 
tary analyses were made to detect trends 
and relationships among the three per- 
ceptual tests, the three verbal tests, and 
all possible pairs of tests. Finally, indi- 
vidual differences in variation were com- 
pared from one category of movement to 
another. Two additional hypotheses were 
examined in this connection: (a) that the 
degree of variation shown by the subject 
in one category of movement is consist- 
ent with that shown in other categories; 
(b) that all or a significant majority of 
subjects are consistent in some one or 
more categories of movement. 

It was concluded from the results that: 

1. The conception of movement in all 
M,FM, and m 
—-might well be related to deep rooted, 


three common categories 


stable characteristics in some but not for 
the great majority of the subjects. 

2. The relationship appeared more 
likely to be found in tests of the percep- 
tual than of the verbal type, but even on 
this basis it did not appear likely for all 
or even a majority of subjects. 

3. If 
bears 


the conception of movement 


any significant relationship to 
psychological processes for more than a 
minority of subjects, then the relation- 
ship is largely specific to certain tests or 
types of tests and test performance is not 


generally predictive from one type of test 
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to another for any individual. 

4. Individual differences in variation 
were not of a generally consistent char- 
acter from one category of movement to 
another so as to suggest that they might 
represent something intrinsically stable 
in the individual except where the sub- 
ject is generally consistent in level of 
movement production. 

5. There was no indication in inter- 
category comparisons that stable indi- 
vidual differences might be generally de- 
fined on the basis of selectively consistent 
tendencies favoring some one or more of 
the several categories of movement. 

The results of the study were con. 
sidered in relation to others reported in 
the literature and were cautiously inter- 
preted to suggest that: 

1. The conception of movement might 


1, Aten, R. M., Ray, C 
The Levy Movement 


D., & R. C. 
Test: Suggestions for 
scoring and relationship to the Rorschach 
Psychol., 


POOLF, 


movement responses. J. consult, 
1953, 17, 195-198. 

2. ALtus, W. D. Some correlates of the group 
Rorschach and the schizophrenia scale of 
the MMPI among two groups of “normal” 
college students. J. consult. Psychol., 1948, 
12, 375-378 

Atrus, W. D., & Thompson, Grace M. The 
Rorschach as a measure of intelligence. 
J. consult. Psychol., 1949, 13, 341-347: 

j. Barron, F. Threshold for perception of hu- 
man inkblots 

correlates. J. 
1955, 19, 33-38 

5. DOrKeN, H. Jr 
sistency of 
pilot study 
48, 525-53) 

», Ercuter, R. A comparison of the Rorschach 
and Behn-Rorschach inkblot 
sult. Psychol., 


movement in 
sonality 


and its per 
consult, Psychol., 


Projective tests and the con- 
the personality structure: A 
J. abnorm. soc. Psychol., 1953, 


tests. J. con 

1951, 15, 185-189. 

7. Evsrein, S.. Netson, JANE V., & TANorsky, R 
Responses to inkblots as measures of in- 
dividual differences. Psychol., 
1957, 21, 211-215 

8. Harrower, Motry R., & Srriner, M. F. Man 

ual for psychodiagnostic inkblots (a series 


consult 


JOSEPH F. 


REFERENCES 


OKARSKI 


well be relevant for some individuals or 


groups but not for others; future research 
might well be directed toward identify- 
ing these classes of subjects and pro- 
viding a basis for discretionary interpre- 
tation in clinical practice. 

2. Tests of the perceptual type ap- 
peared to offer greater promise than 
those of the verbal type for discriminat- 
ing substantial numbers of such subjects. 

g. The utility of individual differences 
in variation for diagnostic classification 
if warranted, at all—is limited to specific 
areas of performance and cannot be as- 
sumed without establishing the stability 
of the observed differences. 

t. The validity of certain basic as- 
sumptions underlying the projective tech- 
niques was questioned and their revision 
suggested. 


parallel to the Rorschach inkblots). Author. 
9. Hays, W., S.. & SLOAN, W. A 
study of the relationship between the verb- 
adjective quotient and the Rorschach ex 
perience balance, J. clin. Psychol., 1951, 7 


224 227 
10. Hutt, M. L., Gipsy, R. G., Mitton, E. O., & 
PoTTHARST, K 


mental 


The effect of varied experi- 

upon Rorschach per- 
formance. J. proj. Tech., 1950, 14, 181-187. 

11. Ives, VIRGINIA, GRANT, MARGUERITE Q., & 
RANZONI, JANE H. The “neurotic” Ror 
schachs of normal adolescents. J. genet. 
Psychol., 1953, 83, 31-61. 

12. Kinc, G. C. Rorschach and Levy Movement 
responses: a research note. J. clin. Psychol., 
1955, II, 193 


“sets” 


195. 


19. Kroprer, B.. & Ketitey, D. McG. The Ror 
schach technique. Yonkers: World Book 
Co., 1946. 


14. MACFARLANE, JEAN W., & TuppeNHAM, R. T 
Problems in the validation of projective 
techniques. In H. H. Anderson, & Gladys 
L. Anderson (Eds.), An intreduction to 
projective techniques. New York: Prentice 
Hall, 1951. Pp. 26-54 

15. MAYMAN, M. A. A comparative study of the 
Rorschach, Harrower and Behn-Eschen 
burg inkblot tests. Unpublished master’s 

thesis, New York Univer., 1947. 


CONSISTENCY OF PROJEC 


Me crzorF, J., & Levine, M. The relationship 
between motor and cognitive inhibition 
J. consult. Psychol., 1954, 18, 355-358 

Mitter, D. R. Prediction of behavior by 
means of the Rorschach test. J]. abnorm. 
soc. Psychol., 1953, 48, 357-375- 

Mitton, E. O. The influence of varied ex- 
perimental sets upon certain Rorschach 
variables: The human movement varia- 
bles. Unpublished doctoral thesis, Uni 
ver. of Michigan, 1950 

Rapin, A. 1., & SANDERSON, M. H. An experi 
mental inquiry into some Rorschach pro 
cedures, J. clin. Psychol., 1947, 3, a 

Rorscuacn, H. H. Psychodiagnostics. Bern, 
Switzerland: H. Huber, 1942 

Rust, R. M. Some correlates of the move- 
ment response. J. Pers., 1948, 16, 369-401. 

. Sanroro, F. H. Individual! differences in the 
mode of verbal expression. .Unpublished 
doctoral dissertation, Harvard College Li- 
brary, 1941. 

SEVERN, D. J. Heteronyms for diagnostic use 
J. consult. Psychol., 1949, 13, 144-145- 


216-225 


Sincer, J. L.. Metrzorr, J., & GotpMman, G. 


MOVEMENT 


C. Rorschach movement responses follow- 
ing motor inhibition and hyperactivity. 
J. consult, Psychol., 1952, 16, 359-364. 

THornton, G. H., & J. P. The re- 
liability and meaning of Erlebnistypus 
scores in the Rorschach test. J. abnorm. 
soc. Psychol., 1936, 31, 324-330 

Tucker, J]. E. Rorschach human and other 
movement responses in relation to intelli 
gence. J. consult. Psychol., 1950, 14, 283- 
285, 

WaALKrR, HELEN M., & Lev, J. Statistical in 
ference. New York: Holt, 1953 

WITTENBORN, J. R. Statistical tests of certain 
Rorschach assumptions: The internal con- 
sistency of scoring categories. J. consult. 
Psychol., 1950, 14, 1-19 

7e8IN, J. Symposium on statistics for the 
clinician. J. clin. Psychol., 1950, 6, 1-6. 

ZUBIN, ]., & YOUNG, KATHLEEN M. Manual of 
projective and cognate techniques. Madi 
son: College Typing Co., 1948 

H. Einfuhrung in den Behn-Ror 
schach test. Bern, Switzerland: H. Huber, 
1940 


(Accepted for early publication April 12, 1958) 


25 
16. 
17. 25. 
: 18 
26 
19 27 
20 > 4 
21 
29 
22 ; 
30 
25 3! 
— 


APPENDIX 


SENTENCE CONSTRUCTION 2 


Stimulus words in order of presentation 


1. the 11. then 21. first 31. with 

2. all 12. because 22. also 32. in 

3. once 13. least 23. any 33. between 
4. both 14. OF 24. within 34. SO 

5. most 5. across 25. as 35. another 
6. often 16. only 26. though 36. about 

7. every 17. although 27. but 37. either 

8. a 18. anything 28. behind 38. therefore 
g. some 19. always 29. how 39. again 

10. each 20. however go. and 40. very 


HETERONYMS* AND MASKING Worps IN ORDER OF PRESENTATION* 


. develop 6. conduct* 11. deliver 16. reprint 
v2. insert 7. examine 12. protest 17. awaken 
3. continue 8. increase 13. assemble 18. commune® 
4. recruit®® g. accomplish 14. desert 1g. resemble 
5. discover 10. escort® 5. distinguish 20. offset 


2 


1. museum 6. suspect® 11. attorney 16. combine® 


2. converse® 7. physician 12. convict 17. mechanic 
3. apartment 8. extract® 13. horizon 18. discount 
4. import g. cathedral 14. insult® 1g. umbrella 
5. potato . progress plano 20. consort 


3 


1. together 6. buffet 11. tomorrow 16. conscript 
2. perfume® 7. unjustly 12. present 17. wherever 
3. extremely 8. survey 13. already 18. ferment® 
4. permit g. whenever 14. compress® 1g. precisely 
5. beforehand 10. exploit 15. exactly 20. compact 


1. romantic 6. transfer unhappy console 
2. convert 7. dramatic 12. produce 17. abundant 
3. familiar 8. project® 12. eternal 18. recount 
4. rebel 9. tremendous 14. abstract ig. eleven 

5. Teligious 10. object 15. peculiar 20. digest* 


REPRODUCTION OF HETERONYM CARD 2, SET 1 
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‘Italicized items: all except those asterisked are from Severn (23). Double asterisked item errone 
ously included; not a heteronyvm. 
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